LIKELY PATH TO EXTINCTION IN SIMPLE BRANCHING 
MODELS WITH LARGE INITIAL POPULATION 



KLEBANER F.C. AND LIPTSER R. 



Abstract. We give explicit formulae for most likely paths to extinction in 
simple branching models when initial population is large. In discrete time 
we study the Galton- Watson process and in continuous time the Branching 
diffusion. The most likely paths are found with the help of the Large Deviation 
Principle (LDP). We also find asymptotics for the extinction probability, which 
gives a new expression in continuous time and recovers the known formula in 
discrete time. Due to the non-negativity of the processes, the proof of LDP at 
the point of extinction uses a nonstandard argument of independent interest. 

1. Introduction and main results 

In population genetics it is often important to look back at the development 
of populations. In this paper we consider the question of how extinctions occur, 
and in particular, what path a population takes on the road to extinction. Using 
asymptotic analysis when initial population values are large, we are able to find 
most likely path to extinction as well as the extinction probability in two simple 
branching models in discrete and continuous time. In both examples we use the 
large deviation principle (LDP) which is non-standard since random processes are 
nonnegative, and we use trajectories ending up at zero. 

One of the contributions of this paper is in rigorous proofs of the LDP for pro- 
cesses on half space. It may appear to the reader that the LDP follows from known 
results in Markov chains and diffusions. This is only partly correct. The standard 
proof of the lower bound in the local LDP relies on the change of measure. This 
requires a certain point (the point where maximum in the Fenchel-Legendre trans- 
form is achieved) to be finite. In our case this point is at infinity, breaking down 
the standard approach. We therefore give complete proofs of LDP's in Sections 
0] (discrete time) and |S1 (continuous time) following the scheme of Puhalskii . 
His approach states that the LDP is equivalent to exponential tightness plus local 
LDP, and is based on the stochastic exponential method (rather than the Laplace 
transform). Although we follow the scheme of Puhalskii we do not use idem- 
potent probability and give direct proofs. Since these proofs are more technical, we 
placed them at the end, after results on extinction. Once the LDP is established, 
the problem of finding most likely path to extinction is in effect the problem of 
minimization of the rate function. This is typically a difficult problem due to non- 
linearity. We are able to solve it by setting up the Bellman equation in discrete 
case, Section 121 and a dynamical control problem in continuous case, Section |31 

1.1. Galton- Watson process. A prototype of a branching model in discrete time 
is the Galton- Watson process, described as follows. 

Let Xn denote the population size at time n, and the number of offspring of 
the jth individual. For each n = 1, 2, . . ., {(C^)j>i} is the sequence of independent 
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identically distributed integer-valued random variables with the probability distri- 
bution function P(^J^ = ^) = p^, £ = 0, 1, ... . The population size at time n -|- 1 is 
given by 

J = l 

where Xq = K > Q. The state {0} is absorbing, and the branching process (X„)„>o 
might be absorbed in {0} at the extinction time 

r = inf {n, : X„ = O}. 

If Po = 0, the population does not become extinct. However if po > 0, it is well 
known (e.g. 0, [Q) that the extinction time r is finite with probability one if and 
only if the offspring mean m = 'Yl,i>i ^Pi does not exceed one (m < 1). Moreover, 
for any m, the distribution function of r is computed using the offspring probability 

generating function f(s) = 'Ylii>{)Pt^^ ^ < s < 1: for any A'^ > 1, 

P(r < iV) = (fA.(0))^', (1.1) 

where f,i(s) is the n-th iterate of f(s), i.e. fra(s) = f(f„_i(s)) with fi(0) = f(0) = po- 
A natural question is how to find the "path to extinction" given that extinction 
occurred at time N , t ^ N. The conditional distribution of the chain conditioned 
on extinction: for ri=:l,...,iV— 1, 

^„|Ar(z) := P(X„ = z|t = iV), i = l,2,... 

gives the complete description. It can be used to find the conditional median or 
the traditional optimal in the mean square sense estimate X„ = X^i^i *'''n|Ar(*)- 
Unfortunately such computations are involved, even using the Markov property of 
(Xn). However, for large values of Xq = K, one path has an overwhelmingly large 
probability compared to the rest. Consider the normed branching process 

^„ - ^ ■ 

The limit in probability P- lim^j-^oo = in exists (see ^U], and satisfies 

Xn+i = tnin, Xq ~ 1. The process i„ is always positive, irrespective of the value 
of m, so that, the approximation Xn is inadequate for study of extinction, the fact 
is already mentioned in Pj. In the approach we take, {Xn)n<N is approximated on 
the set {r < N} by a deterministic sequence u* := (u* )n<Ar with Uq = 1, positive 
M* 's and u*j^ = 0, such that for small S > and large K, 

N 



T < N 



n=l 

This choice of u* might be warranted by the following argument. Since fn(0) 
increases in n, for large K, (fAr(O))^ is considerably larger than any of (fn(O))'^ 
for n< N. Then, by (HHl), P(r < iV) = P(t = N) + P{t < N - 1) ^ P(r = N). 
Consequently, for any u. ~ {un)n<N with uq = I and u„ > 0, 

TV 

P(^|xf -z.„|<<5) <p(T<iv). 

n=l 

For large K, extinction for the process x^ is a rare event, since the limit process 
Xn is positive. Therefore, as in |14| . we approach the problem of extinction using 
the large deviations theory, obtaining a new result as well as recover an asymptotic 
version of the well-known result (|l.l(l by using this theory. According to LDP, The- 
orem ETI and by analogy with the maximal likelihood estimator, the path (u* )n<Ar 
is said to be the most likely path to extinction of the normed population Xn ■ 
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Clearly, t is the extinction time for both processes X„ and x„ , so that, Ku'^ 
(with large K) sets the pattern for the extinction path in the original branching 
process. 

Figure below demonstrates likely paths to extinction for a binary splitting model 
with different parameters, p = po, illustrating the general result. 




For formulating the main result, we use the log moment generating function, 
assuming its existence up to some to > 0, 

0(t) =log^e«p,, t e (-oo,to). (1.2) 

e>o 

It is related to the moment generating function by 

logf„(0) EE 0„(-oo) (LcmmaEH). 

Theorem 1.1. Assume po > and (|1.2() . Then, for any N > 1, 
(i) 

1 ^ 

{Un)n<N = argmax lim lim ^logPf ~ Un\ < S 

Mo = l,tijv=0 S-^OK^ocK ^ , 



MO = i,tlJV 

u„>0,n<N-l 



with 



4= n b' i9N-^i-oo)), n<N, (1.3) 



where Qi{t) is i-th iterate of Q{t), go(i) = t- 
(ii) 



1 ^ 1 

lim lim - log P ( ^ |.Tf - ul\ <6)^ lim - log P(r < n)) . 

n=l 

1.2. Branching diffusion. In continuous time, we consider the model of a branch- 
ing diffusion Xt defined by the Ito equation 

dXt = aXtdt + a^/x~tdBt (1.4) 

with a positive initial condition Xq = K, where Bt is a Brownian motion, > 0, 
and a G R. Stochastic equation (|1.4|l possesses a strong nonnegative solution. Since 
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the diffusion parameter degenerates, one way to see this is to construct the sohition 
from the following approximating sequence {Xf )i>i: 

i>l 



where dXl = aXldt + <yyJ\Xl\ V i-'^dBt, X'^ = K, and n = i^H^l < «"^} t^e 
increasing sequence of stopping times (Ti)i>i relative to the filtration generated 
by Brownian motion (Bt) (see also Theorem 13.1, The strong uniqueness of 

1)1. 4|l follows from Yamada-Watanabe's theorem (see, e.g. Rogers and Williams, p. 
265 [21]) since its drift and diffusion parameters are Lipschitz and Holder (with 
coefficient i) continuous respectively. 
Obviously, 

T = inf{t ■.Xt = 0}= lim r,. 

i — 'oo 

We analyze the normed process = Due to H1.4)l . xf- solves the Ito equation 

dxf = ax'^dt + -^^/~^dBt, (1.5) 
with Xq = 1 . It can be readily shown that P- lim/i-_+oo xf^ = Xt exists and solves 

dXi^ 

= axt, xq ~ I. However, xt is always positive and is far from to be estimated 

..... . 

path to extinction. As in the discrete time, in order to evaluate path to extinction 

for {xf)t<T for fixed T > 0, we approximate {xf)t<T on the set {r < T} by a 

deterministic function {u^)t<T with Uq = l,u^ = and > 0, such that for a 

small S > and large K, 

P(sup|a;f - u;\ <6)> p(sup|a;f - ut\ < s) 

for any (ut)t<T from the set {uq = 1, {ut > 0)t<T,itT = 0}. 

Unfortunately, the useful formula of (|1.1|) type is not known to us in this case. 
Here we obtain its asymptotic version a,s K oo, sec (ii) below. 

Theorem 1.2. For any T > 0, 

(i) 

(w( )t<T = argmax lim lim — log PI sup jx'f^ — itt| < (5 



ut>0,t<T 



is given by 




(1.6) 



(ii) 

lim log P(r < T) = lim lim ^ log P f sup |a;f - u^* | < s) 




Corollary 1. (1) ^* has the remarkable property: it is the same for subcritical 
and supercritical case: ul{a) = Uj(— a). 
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P(r < T) « exp - 



(2) For large K , the probability of extinction in [0, T] is given by 

K a 

In particular, for a = 0, P(r < T) « 2<T^r . 

2. Proof of Theorem [TTTI 

Wc begin with 
Lemma 2.1. For any n > 1, g„(— oo) = logf„(0). 

Proof. The result foUows by induction from the identity g„(logt) = logf„(t) for 
t G (0,to). Write 

0(log(O) = fog5]e^'°s(*)p, = log^e'°s(*'V = fogJ^tV = logfW- 

f>0 ^>0 l>0 

If 0„_i(fogt) = fogf„_i(t), then 

fl„(logt) = 0(fl„-i(O = fl(log(f„_i(0) = logf(f„-i(t)) = log(f„(0). 

□ 

The proof of Theorem 1 1.11 is done in a number of steps. 

(1) Recall that g(t) is convex function with g(0) = 0, 0(— oo) = log(po) and 
Q'{t) > 0, t > -oo while 0'(-oo) = limt_oo 0'(O = 0. 

(2) By the local LDP (see, Theorem 14.1(1 . for uq = 1, Uf4 = and other positive 
M„'s, it holds 

~^ 7i<N n<N 

(3) In order to find (w* )„<Ar such that for uq = 1, u„ > 0, ~ 

we apply the Dynamic Programming. 
Since un ~ 0, 

I{un,Un^i)= sup (-■UAr„i0(t)) = -■UAr_i0(-Oo) =: B„(uAr_i) (2.2) 
t6( — oo,to) 

is the boundary condition for the Bellman equation 

B«(un-i) = inf [b„+i(u) + /(u,w„_i)1, l<7i<iV-l. (2.3) 

«>0 L J 

For n — 1 , we have 

BAr_i(ltAr_2) = inf - u0(-oo) + sup {tu - Un -22{t)} ■ (2.4) 

L te(-oo,to) ^ 

(|2.4|) provides the inequality, 

Bn-i{un~2) > inf [ - ug(-oo) + tu - ujv-20(t)] , V < G (-oo,to) 
which, with t = g(— oo), is transformed into 

Bn-i{un-2) > -UAr_2fl2(-Oo). (2.5) 

We show that the above inequality is equality. For u,un-2 > 0, "sup^" in 1(2.4(1 is 
attained at the point t* = t* (u,un-2), so that, for any u> 0, 

Bn-i{un-2) < u[r(u, UAr_2) - 0(-Oo)] -UN-2Q{t*{u,UN~2))- 
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We choose u = u*j^_^ such that i* MAr„2) = 0{—oo). This is possible since 

fl(-oo) logpo, <*(0,ujv-2) = -oo, 
g'(-oo) = 0, t*(m, Un-2) = 0, g'(0) = m, 

so that, the existence of u*j^_-^ follows from continuity, in u, of un^2)- 
The choice of u*j^_-^ gives the inequality 

BN-liuN-2) < -UjV-20(i*(wJsr_i,UAr-2)) = 0(fl(-oo)) = 02(-Oo). 

Consequently, the opposite inequality for (|2.5|l holds true and, therefore, 

BN~liuN-2) = -■UAr_202(-Oo). 

It is obvious too that for any un^2 > 0, 

w^-i = u N -29' {t*{u*j^_-^^, UN ^2)) = uw-20'(fl(-oo)). 
Further, by induction, we find the following pairs: 

U*N~1 = 0'(0(-Oo))"W-2 
Bn^i{Un_2) = -02(-Oo)u^_2 

U*N~2 = 0'(02(-Oo))u?^-3 
Bn-2{Un-3) = -03(-Oo)u^_3 



"1 



(0«-i(-oo))uo 



Bi{uo) = -0„(-oo)uo (wo = !)• 

With chosen (u* )i<„<Ar_i, the Bellman equation (|2.3|) is transformed into the 
backward recurrent equation 

i?„«_i) = S„+i«) + /«,<_i), l<n<N-l 

with boundary condition —u*n_iQ (-00) (see, (ES)- 

Thus, = Ei<„<w^«'<-i)- 

On the other hand, the Bellman equation also yields 

Si(l) > ^ /(w„,M„_i) + Bjv(uAr-l) = ^ /(w„,u„_i) 
l<n<Ar-l l<n<N 

what proves (|2.1|l . 

(4) We recall that J2n<N -^i^n^'^n-i) = ^0n(^oo), that is, by Lemma ITTl and 

^ /«,<_l) = -logfAr(0) = --ilogP(T<7V), Vi^ >0. 

l<n<JV 

(5) Thus, (l)-(3) imply the statement (i); formula follows from recurrence 
< =0'(02(-oo))<_i, u*o = 1. 

Finally (ii) follows from (4). □ 
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3. Proof of Theorem [Ql 

We apply the LDP Theorem 15.11 By the local LDP. with mq = 1, > and 
mt = 0, we have 

lim lim —logP( sup \xf — uA < s\ = —Jt{u), 

where Mu) = l^^ ^^^hu.>o}dt, uo = l, du, = u,dt 
Icx), otherwise. 
Therefore (i) is reduced to minimization of Jt (u) in a class of absolutely contin- 
uous test functions ut with uq = 1, ut > and ut ~ 0- 

Set Wt = — -, t G [0,r) and notice that the minimization of Jt{u.) is 



equivalent to the following control problem with the controlled process ut, solving 
a differential equation 

Ut = aut + y/vdWt, t e [0, T) 

subject to Uo = 1. The control action wt belongs to a class of measurable functions 
with wfdt < oo bringing ut to zero at the time T. The control action from 
this class is optimal if for any wt , 

T pT 

*^2 ^ / „,.2, 



(wlrdt < / wtdt. 
Jo 

If W( exists, then the controlled process related to minimizes Jt{u.) in the 
required class of continuous functions u. = (ut)t<T- 

In order to find , it is convenient to deal with (recall Ut > 0) Vt = ^/ut since 
Vt solves the linear differential equation vt = ^Vt + ■^Wt, vq = 1. If wl exists, then 

brings Vt to zero at the time T, that is, ~ vt = e"?^ + e^^'^~*^w1dt or, 
equivalently, 

e-^'wldt. (3.1) 



Hence, by the Cauchy-Schwarz inequality 1 < ^ e *°'dt J^^ (wt)'^dt, that is, the 

following lower bound holds: {wD'^dt > This lower bound is valid for 

any wt providing H3.1() , so that, the condition 



(w^fdt 



1 - e-"^ 

is valid for wl = ce"*'^ for any constant c, bring Wf = c*e~*'^ with c* solving 
-1= / e-^'iwtdt^c* f e-^^dt. 

Hence, 
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Finally, we find that 



1 - e-T^ 
1 - e-*" 



e(*-^)fe-^fds 







1 - 



1 -e-'T"- 

and, since u\ = (y\Y ^ "^c obtain H1.6|l and the proof of (i) is complete, 
(ii) By (i), 



We show that 



W) = -- — 

cr^ 1 — e 



lim — log P(r < T) = Jt(w*). 



(3.2) 



To this end, use the fact that {r < T} = : 3t < T, (tj) = 0}. For 

notational convenience denote 2t := {r < T}. Set 2t=' and 21'"' the closure and 
interior of 21. Then, by the LDP, we have 



lim — logP(2l"') < 



inf JtW) ~ — inf Jt(u ) 

'u^>0,s<t; t<T 
u:{ Ut—0 
t<T 



lim — logP(2t'"') > - inf Jt(w) = - inf J* 



' Us>0,s<t; 
u:{ Ut—0 
t<T 



t<T 



Since lim 



K- 



= lim 



K~*oo 



implies the existence of lim/<-_>oo, it remains to show 
that iuft<T Jt{u*) ~ Jt(u*). 

Notice that (|3.2|) is valid with T replaced by any t < T with u* replaced by the 
corresponding u*'* = {uq'* = 1; m*'* > 0,s < t; m^'* = 0}. In other words, for any t, 



(T^ 1 — e 



and Jt{u*'*) increases to Jt{u*) with t / T. 



□ 



4. LDP in Discrete Time 

Let m = inf{n < iV : u„ = 0} and m = cx3 if all {un)n<N are positive. 
I{y,x)^ sup [ty-xQ{t)]. 

tG( — oo.to) 

Theorem 4.1. Assume H1.2|l . For any N > 1, the family {(a;^)„<7v}if->oo obeys 
the LDP in , supplied by the Euclidian metric g^, with the speed and the rate 
function 



JAr(u.) 



I[Un, Un-l) - Um-1 log(po), „„=0,„im 



n=l 
N 

/(m„,m„-i), 

n=l 

oo, 



uo = l 
u„>0,ri<Ar- 

3 n:tt„— 0,iiTi+i >0 
or UQ^l 



Remark 1. LDP for branching processes have been considered in the literature, 
see, for example, 0, 0, jttHI- However, they were concerned with the sequence 
^ , as n ^ oo, whereas here we consider the LDP for ^ processes indexed by 
the large initial value. 
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Remark 2. The nonnegativity of provides some difRculty for verification of 
LDP at the "point of extinction" where the test function becomes zero. For set § 
of test functions that keep away from zero the statement of the theorem is imphed 
by a result in Klebaner and Zeitouni, and other known results that can be 
adapted to our setting (sec, e.g. Kifcr, 0, Puhalskii, ^Sj, Klebaner and Liptser, 
|12j . etc.). But {r < N} ^ § , and for the sake of completeness and accuracy we 
give the complete proof below, with a new proof of the lower bound in the local 
LDP. 

4.1. Proof of Theorem 14. IL We follow standard (necessary and sufficient) con- 
ditions for proving the LDP by showing the exponential tightness: 

lim lim — log Pfi7 \ /Cc) = ^oo 

with compacts ICc ~ {maxi<„<Ar xjv < C}, C /" oo, and the local LDP: 

hm hm log P (pAr(a;^, u.) < (5^ = — JAr(u.). 

Notice that p.2|l implies the existence of a stochastic exponential, with t„ < Kto, 

N 

'(^ ,...,*„)(a;f , ■ • ■ , ^N-i) = n E(e*"-" |^„_i 

n=l 



where {^n)n>o is the filtration, with = {0, i7}, generated by (a;„ )„>i. 
Set 

The random process dm ■^n)n<N is the (positive) martingale, 

EjAT = 1. (4.2) 

4.1.1. Exponential tightness. Since maxi<„<Ar2:f^ < X]i<n<Af^n^' enough to 
show 



hm hm -^logPf = 



C — »oo K — ^oo K 

l<i<N 

Set t* = argmaX(g(_o^ j^)[t — g{t)]. Since g(0) = 0, we have that t* e (0,to) and 
g(r) < t*. We choose t„ = t*K{< Kto), and introduce 21 = {T,i<i<n^f > C"}. 
With chosen we have E^n = 1 and, therefore, E/ajjv < 1- Taking into account 
this inequality and H4.1(l . write 

> E/2ie^'^^{i<"<«}[*'-'''**^l'^"-^l8(t*)l 

> E/ae^*^!*'""**')! = e^'^[**~''(**)l~-^lf(**)lp(a). 

Therefore, ;^logP(2t) < - [t* - fl(r )] C + |g(r )| > -oo. □ 

V ^ z C~*oo 

>0 

4.1.2. Local LDP. Upper hound. Wc may restrict ourselves by the test function 
u. ~ {ui, . . . , uat-i, upf } and show that 



>o =0 



lim lim 

K^oo K 



^logP(eA.(x^,u.) < ,5) < -Jn{u.). (4.3) 
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For the test function with all positive ti„'s and uq = 1 the proof of H4.3|l is similar. 
For test function with u„ = 0, > or uq 7^ 1, (|4.3() is obvious. For others test 
functions the verification of l|4.3|l is reduced to the above-mentioned ones. 
Let now 21 = {pn{x^ ,u.) < S]. By H4.2|l . we have 

1 > E/ajAT = E/ae^ (4 4) 

Set = argmaX(g(_3^ j^j) [iu„ — w„_ig(t)], n < — 1, and ^ —I {I > 0), and 
take i„ = Kt*^, then we derive from (|4.4|l 

= E/ae^'^{i^"^"-i> ^(""'""-i)~""-iB(~''l~-'^Si<"<N-i(ld+l0(OI)'5 
= E/ae^["'"-i("-)"""-i*'("')l"-^2i<"<"-i(l*"l+l8(*")l)''. 
Hence, taking into account that lim;_,oo 0(^0 = log(po), we obtain 

-ilogP(2l) <-[J^^_l(«.)+^iJv-l0(-O]+ E I + 

l<j<Ar-l 

> -[JAr-i(u.) + MAr-ig(-0] ' -Jn{u.). 



s^a i^oQ 



4.2. Local LDP. Lower bound. Obviously for u. with Jm{u.) — 00, it is nothing 
to verify. Further as in the upper bound verification, we may restrict ourselves by 
the test function u. — {wi, . . . , uat^i, uj^ } with P{S,\ = 0) = po > and show that 

>o =0 

hm lim -^\ogP(QN{x^,u.)<5\>~JN{u). 
(5-+0 00 K \ J 

Write 

{qn{x':,u.) < (5} = {q]s^i{x'!,u.) + x'^ < 6} 

D {^?A^_l(a;^ u.) < 0.5(5, < 0.55} 

D {£.Jv-l(a;^^t.) < 0.5(5, cc^ = O} 



^ JV — J. 

D {g^_l(x^^i.)< 0.5(5, - E ?^ = 0} 
D{g^_l(x^^i.)< 0.5(5, - E e^-o} 



{^^^_l(x^«.)< 0.5(5, E e^ = o}. 



The sets 2li = {gAr^l(a;^ u.) < 0.5(5} and Sta = { Ejl^r^'^'^' = 0} are inde- 
pendent, so that, 

p(eJv(x^«.) < (5) > p(^?w-l(:E^M.) < o.5(5)p^(""-i+*)(ej = o). 

Consequently, 

lim lim ^ log P(giAr(a;'', u.) < (5) 
> lim lim log P(£»jv-i(a;'', u ) < 0.55) + uat-i log P(Ci = 0). 

5^0 K^oo " 



LIKELY PATH TO EXTINCTION IN SIMPLE BRANCHING MODELS 



11 



If 

lim lim ^\ogP(gN-i{x^,u.) <5) >-Jn^i{u.), (4.5) 

provided that u„ > 0, n < A'^ — 1, the required lower bound holds true. 
Thus, it is left to verify the validity of H4.5|l . 

Set Ajv-i(a;:'^) = 3jv-i, that is, 



A 



We introduce the probability measure Q^_i with dQ%_^ = AA,_i(x^<')dP. bmce 
A„_i(x^) > 0, P-a.s., we also have dP = K;^\[x':^)dQ^_^. 
In particular, for 2t = \^qm~i{x^ ,u.) < (^j-. 



P(a) = / K-^\{x'<)dQ%^,. 



'a 

So, the following lower bound, on the set 21, is valid: 

> g--ftrJN-l(M.)--ft:<5max„<„_i(|t;| + |g(t;)|) 

or, equivalently, 

-ilogP(2l) > -Jn-i{u.) - S max (ICI + \g{tl)\) + 1 logQ^^_i(2l). 

A n<N—l A 

The latter inequality implies (|4.5() if 

hm llogQ^„i(2l) = 0. (4.6) 

K^oo A 

A simple condition, providing (|4.6|l . is limi^-^oo Q^_i(2l) — 1 or, equivalently, 

lim Q^^_i(£)w_i(x^,u.) >5)=0. (4.7) 

We verify 14.7|l by showing^ 

N-l 

^N-10N-lix •'"•) = 2^ ^-0 (4-8) 

^ n=l 

Notice that the positiveness of {un)n<N-i provides a boundedness for the right 
hand side of H4.8|l ' and, in turn by Chebyshev's inequality, the validity of (|4.7|l . 
In order to establish H4.8|l . we apply the identity relative to t* : 



1 = E 



A„(x^) 



.^n-i ) - Ee^ L'""- . (4.9) 



Differentiating twice H4.9|l in t* , we find that 



[t>^'-^^-is(C) 



A„_i(cc^) 

A„(x^) 



= e({K[x^ - x,f_iB'(C)]^ - -n-i0"(C)}£3^ 



(4.10) 



l(x^) 

By the Bayes formula, e.g. )17| . for any integrable random variable a, 

A„(:c^) 



Ej^_i(«|^„-i) = E « 



A„_i(x^) 



^E^_j^ denotes the expectation with respect to Q^_]^ 
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By taking a = and a = [x^ — x^_iq' {t*)]"^ , we derive with the help of H4.10(l 
that 



E^-i(2:^l^«-i) = x-^i0'(C) (4.11) 
E^-i(kf - x,li0'(C)]2|^„_i) = (4.12) 

Since Un,Un-i are positive, we have s'i^n) ~ ■ Hence and by H4.11(l . we 

obtain that ^^_^x^^ = :^^^E^_j^.t^_]^. Consequently, iterating the above recursion 
and taking into account uq = 1, we find that 

Further, with the help of H4.12|l we find a recursion 



_^(^^)2 = (^)^E^_,(X^_,)2+.„_1 



3"(C) 



By using E%_j^{x^ - u^f = 'E.^_^{x^Y - u\ and and u\ = 
establish a recursion for A„ = E^_^{x'^ — u„)^: 



A„ = A„_i + Un-1- 



'(C) 



if 



supplied by Aq = 0. Then, ^ = and 



< " ^ ^ """-^ - ^ ,^1 ^ 

It is left to recall that A^^-i ~ E^_^gj^_^{x^'^ -jU.). □ 



5. LDP in Continuous Time 

We introduce the filtration {•^^)t>o generated by Brownian motion Bt, with the 
general conditions. All random processes considered in this section arc adapted to 
this filtration. Henceforth, by agreement, 

I- 

Theorem 5.1. For any T > 0, the family {{x^)t<T}K^oo obeys the LDP in 
C[o,T](IK+), supplied by the uniform metric qt, with the speed and the rate func- 
tion 



Mu.) 




uq ~ 1, duf ~ iitdt, 
otherwise. 



Remark 3. Since ut > 0, Freidfin-WentzcU's rate function, 0, 5^ /g^ <£i:z^h)ldt 
is not compatible with ut = 0. Our branching diffusion model is a very particular 
case of a model studied by Puhalskii in [20]. To apply the LDP analysis from 
[201 to the family {{xf)t<T}K -too, one has to "disentangle" many details of the 
proof to make it compatible with our case. Finally, in Donati-Martin et all, [5], 

the LDP analysis deals with a rate function of the following type uf ^"-"^ 

Mt > related to a family of diffusion type processes without extinction. A reader 
interested in details of the direct proof can find them below. 
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Proof. It suffices to verify: 

(i) C-exponential tightness (see [TK]'l. 



lim lim — log P f sup xf^ > = — oo, (5-1) 

lim lim sup log P ( sup j — x^\> '?) = -oo, V > 0, (5.2) 

where 7 is stopping time relative to {•!^^)t>o, 
(ii) the Local LDP, 

1 , ,K 



lim lim — logPlsup xf — ut \ < <5 ) = — Jt(u.). 



(i)-Verification. The Ito equation (|L5(I is equivalent to the integral equation 

1 



cf = e"'(l + J*e-°"y^dB,). Hence 



(5.3) 



supxf < 2el"l^(l V -^sup / e-°"Jx^dBs), 

t<T ^ V /i t<T Jo ^ ' 

so that, H5.1|l holds true provided that 

lim IW 4;logPfsup / e-'^\[^dBs>'jKC\ = -00. (5.4) 

In order to verify (|5.4|l . let us introduce a continuous martingale and its variation 
process 

Mt = -^ / e-''\ x^dB, and {M)t - — / er^^'x^ds 

respectively and the stopping time tc = inf{< < T : Mt > C}, where inf{0} = 00 
which enables us to claim that (|5.4|) is valid if 

lim Ih^^ 4^ log P (re < T) = -00. (5.5) 

We proceed with verification of H5.5(l . With A > 0, set 

It is well known that the process {}tT^^)t>o is the positive local martingale and 
so, the supermartingale too with E^g < 1 for any stopping time 9 relative to {^f)- 
By choosing 6 ~ tc, we find that 1 > E/{g<y}3e- Then, due to a lower bound on 

the set {e < T}: logje > AC - e"^"^xf ds and ifHl^ there exists positive I 

such that 

Further, a choice of A = {i+c)i ™pli6s ie > e (i+c')' . Consequently, 
llogP(rc<T)<-^^-oo. 

By H5.1|l . the proof of (|5.2() is reduced to the verification of two conditions: for 
any ry, C > 0, 

hm lim sup— log P( sup / x^ds>ri, supa;f^<C) =—00 



lim lim sup — logPf — ^ sup 



7+t 



> 77, supxf^ < C*) = —00. 
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The first is obvious while the second is equivalent to 

lim IW sup ^ log P f sup It c \ M^Lt - Mf" I > ?;) = -oo, (5.6) 

where It.c ^{sup,<j xK<c}, t < T. 

Set = A'/^t - and notice that [N^ , ■^^+t)t>o is a local martingale with 
the variation process {N^)t = ^ X^"*"* xfds. 

Further, the use of It,cN^ = It,c /q Is,cdNf simplifies (^21) to 

lim Km sup ^ log P ( sup / IscdN^f >ri\ = — oo. (5.7) 
The local martingale N^''^ Is^dN^ possesses the variation process 

{N^-'% = Is.cd{N^)s = ^J^ Is.cxfds, 

that is, d{N'^'^)t < ^dt. 

Now, we are able to verify (|5.7() with the help of stochastic exponential technique. 
Let 

3,(A) = e^^"'"-^<^"'">', AgM. 

Since 3t(A) is a continuous local martingale and supermartingale too, for any stop- 
ping time 9, E.ie[\) < 1. Let 9 = mi{t < A : N^''~' > rj}. Taking into account 
that {9 < A} = {N^''" > T]}, write 1 > ^I{e<A}}eW- The value 3e(A) is evaluated 
below on the set {9 < A} as follows: with A > and {N^-^)e < ^9 < ^A, 



3«(A) > e^"-^ 

Therefore, log P(6' < A) < - [A?? - ^^^^ A] and the choice of A = provides 

1 772 
— log P(9 < A) < ^ — > -00. 

It is clear that the same result remains valid for 9 = inf{i : —N^''^ > 77}. Combin- 
ing both, wc obtain (|5.7(l . 

(ii)-Verification. The upper bound. For mq 7^ 1 or dut ^ dt, the proof 
is obvious. For uq = I and dut = iitdt, the stochastic exponential technique 
is applicable. With an absolutely continuous deterministic function X{t) let us 
introduce a continuous martingale Mt and its predictable variation process {M)t'. 

nt J ^2 /-t 



Mt = ^=j X{s)Jx^dB, and (Af)t = — / X'^{s)xfds. 
wK Jo Jo 

It is well known that the stochastic exponential 3* = e*^*"*^-^^*^^* is a local mar- 
tingale and a supermartingale too with £3^ < 1- The use of this property implies 

1 > E/{sup^^^ |2.r'_„^I<5}3t. (5.8) 
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The next helpful step of the proof gives a deterministic lower bound for on the 
set { supj<j. \xf - ut\ < S} =: Sl^. By (fO| . Mt = /g X{s){dx^ - axfds), so that, 



log3T = A(s)(dxf - axUs) ^'{s>sds 



ds 



+ / A(s)d(xf - u,) h At(x# -ut)- / (< - u,)Xtds] 



X{s)a{ 



x^ — u. 



> 2K ^ 



a-5 - Uf 



ds. 



Now, by taking A(s) = Kd{s), wc find a lower bound of on the set 2I5 := 
{swpt<T \xf - Ut\ <6}, 



\0t\+ m + \a9{s)\ + 



ds 



6K 



ds 



This lower bound jointly with 15.8|l implies the following upper bound: for any 
absolutely continuous deterministic function 9{s), 



lim lim — logPfSt^) < 



{s){us - aus) - —9^{s)us 



ds. 



Since Us is only nonnegative, it makes sense, for computational convenience, to use 
a corrected upper bound, with e > 



lim lim — logP(aA-) < - / 9(s)(us-aus) 9^(s)(u, + e) ds. (5.9) 



If Ut is absolutely continuous function, a choice of 9(s) = provides 

[us + e) 



lim lim — logP(a5) < --^ / 

s^o K^oc K ° ^ ■' 20-2 Us+ e 



1 

'2^ 



ds 



ds, e \ 0. 



In general case, one can choose a sequence 6'„(s), n > 1 of absolutely continuous 
functions such that 



lim 

n— >oo 



i(s)(ms - aus) - -^9,^{s){us + e) 



= sup 
2f72 Us+e 



[iis - aus) - —4> {us + e) 



Hence, for sufficiently large n, \9n{s){us — augds) ~ ^9'^{s){us + e)] > 0. Then, 
due to H5.9|l being valid with 9{s) replaced by 9n{s), and Fatou's theorem, we find 
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that 



1 r 

Hm hm — logP(2l5)<- lim / 6'„(s)(iis - aus) 



ds 



< 



T 

hm 

n — 'oo 



,(.s)(w, - au,) - y 0^(s)K + e) 



ds 



1 

2^ 



tic + £ 



2a2 



(ii)-Veriflcation. The proof of 



e\0. 



hm lim — log P ( sup | 



-uJ<S]> 



1 

2^ 



Ut 



dt 



(5.10) 



(5^0 . 

is done in three steps. 

1. It sufBces to analyse the case /p'" ^ which enables us to 
consider only those test functions that remain zero after arriving at zero. In other 
words, we shall give the proof of H5.10|l for absolutely continuous u. with uq — 1 
and {ut > 0)t<T, "t > 0. 

2. Set Tc = inf {t < T : xf > C}, where inf{0} = oo and notice that if for 
any C > 



lim lim — logP( sup \x 



s->a K-*oQ 



K 



„K 



t<T/\TC 



<S]> - 



1 

2"^ 



■dt, (5.11) 



then H5.1()|l holds. This can be seen as follows. Since 

Sla^l sup \x^ - ut\ < S] n {tc = oo} 

^ t<TATc 

= 1 sup \x^-ut\<s}\\ sup \xf -ut\<s}n{Tc <T}, 
we have {tc < T} U 21^ D { sup(<y^^p \x^ — Ut \ ^ 6} , so that. 



> P( sup \xf ~u,\<S 

t<T/\Tc 



2\P{^s) V P(rc < T 
Hence, due to (|5.11|) . 

lim lim ^logP(2la)\/ lim lim — logP(Tc<T 



> — 



2cr2 



T („: „„, ^2 







{iit - autY 

Ut 



dt 



and it is left to recall that {tc <T} — { sup«;j. xf > C} and to refer to H5.1|l . 

3. By 1., ii^dt < oo. We proceed with the verification of H5.11() . Define a 
continuous martingale Mt and its variation process {M)t- with e > 0, 

Mt = 



^ u, ax, ^^^^ ^^^^^^ 







a^{x^ + s) 



a^x^ + i 

By definition of rc, we have {M)t < Jq {uf + a^C^^ds < oo, so that the 
stochastic exponential (3i, P)t<T with = g^tt-o.5{M)t jg uniformly inte- 
grable martingale, Ejt = 1- We use the latter property to define a new probability 
measure P on (il, ,^^) by letting dP = irdP and apply 



P( sup |xf-ut|<(5 

^ t<T/\Tc 



dT^dP 
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for verification of H5.11|l . This approach heavily uses a semimartingale description 
of the processes (xf P)t<T and , P)t<T- We begin with the process 

{Bt,.^P , P)t<T- The random processes {Bt,.^P , P)t<T and {it^^f , P)t<T are con- 
tinuous martingales and, in particular, 

, ^ r— ut — axf 

"3t = I{Tc>t}hyK dBt. 

cr\/xt + £ 

Hence, the co- variation process for ^t, Bt is defined as: 



It is well known (see, e.g. Ch. 4, §5 in ^^1) that the random process (Bf, ^t^, P)t<T 
with 



Bt = Bt- / ij'd{i,B)s=Bt 



a{xf + e) 



ds 



is a Brownian motion. Consequently, we find that, P-a.s. 



log 



xf = 1+ I I{rc>s}Usds + 



^ „ x^dB, 
VA V 



(5.12) 



1 



2 7„ a2(xf+e) 



Now, we evaluate from below the value log on the set {supj^ji^^^^ jxf — Ufj}. 
Write 



1 /■ {us - aus)' 



= sup 

'K t<T 



Us 
t/\rc 



ds + h{C, e, 5) 

K 



Us — ax 



a^xf + e 



--dB, 



where h(C,e,S) > 0. Therefore, (15.121) can be transformed into (here 77 is a 

positive constant) 



1 

K 



logP( sup \xf -ut\ <6]>- 



t<T/\TC 



1 f (us - aUsY 



2<y' Jo 



1 



- log P sup \x^ — ut \ < 5, -^j= sup 

V t<TATC 



'K t<T 



u. 

tATC 



ds + h{C,e,6) 



Us — ax 



K 







(J^Jx^ + e 



dBs < 7] 



This lower bound makes it possible to claim that (|5.11|) holds true, provided that 



lim PI sup 

K^oo \t<T 



*^^<^ iis-ax^ 



> VK7] = 



lim lim P( sup \xf - ut\ > 5) = 0. 

E^O K^co \ t<T/\rc 



relative to E) 
E( sup 



u,~ax^ 



(5.13) 
(5.14) 

the Doob inequality (here E is the expectation 
U\us\+Cy 



a^xf + e 
jointly with 3., establish H5.13|l . 



dBs > yKf] 



< 



-ds. 
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Due to the first part of H5.12|l . tlie proof of H5.14|l is reduced to the verification 

of 

lim sup .T 1 — ( ) = 0, 

e-*"o<2:<c L \x + eJ i 

which is obvious, and 

lim P( sup / JxfdBs > VKrj 

K~*ca \t<T Jo * 

which is similar to the proof of (|5.13|) . 
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